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data entry capabilities of the P=3C oreration2a! software. 
Thirteen military officers executed a P=3C Tactical 
Coordinator's prefiight task of entering data into the 
Stores Management and Navigation Preflight tableaux. 
Gverall, voice entry was found to be faster for the 
Stores Management: data entry task anu stower for the 
Naviaation Preflight tableau task, with comparable accuracy. 
Bute for subjects with prior voice inout experience, voice 


inout was fastar than keyboard entry for both tableaux. 
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Additionally, oata which ts mission scecific is loaded onto 
the end of the onera:iona! proaram tare into a oreflight 
data insertion program or FDIF hy personnel] from tne ASWOC. 
One of the areas of difficuity in comrletina the PDTP is 
the insertion of search stores into the "Stores Management” 
tableau. Search stores are comorised of sonooouvsr smoke 
markers, and bathythermoaraphs. UGhanging reauirements and 
availability of marticular «¢ ‘aus for a soeciv’ic mission 
often precludes the insertion of these sonohouys into the 
POIP. The lacco must then enter the sonobouys into the 
"Stores Management" taodleau after preflightina the aircraft 
and subsequent te ltosadina of the onerational rrogram. The 
orocess is time consumina and errors frequently occur due to 
distractions from other crewrmemvers and because of the 
redundant nature of the task. 

Previcus studies, hy Lea [Kef. 1] and Fueae and Greer 
fRef. 2) have looked at the work load of crew members and 
have exmlored the possible use of automated “speech 
technoloay to tnerease onmerator performance during various 
portions of the P=3C mission. This study will evaluate- the 
use of the Model [600 Threshold Technoloay, Inc. voice 
recoanition unit during pre-flidht data entry tasks 
performed py the Tactical Coordinator in the P-3C aircraft. 
Results of the voice data entry method will be compared 
with those using standard keyboard entry method considering 


the metrics of 1) entry speed, and 2) accuracy. 
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BR, GENERAL CUNSTDFRATTONS IN ManeCOMPETFRr INTERACTION 

Man has one cnanne!l - speecn = with which he does most 
of his communicating with ether neanle, and three channels - 
manual, visual and audio ~ with which ne does rost of his 
communicatina with nis machices. In yveneral, manual maans 
are used in ran-comouter communication and visual means are 
used in comeuter=man communications. Keyboards, of course, 
are the orimarv inout device in most anpolications, However, 
that doesn't mean that they are, srecessarily, the pest tyoe 
for most aovplications. The following auestions should he 
answered before tnat judament is maae: 


1. Ts the input alphanumerics, strictly digits or words, 
or sentences etc.? 


@. ITs the input strictly formatted? 


3. Is there considerable mental or visual effort required 
to menipulate the data before it can be entered? 


4. Te what extent will the inout he interective with the 
computer? 


5. What will be the mobilitv requirements for the 
noerator. : 


6. Js it desirable for the operatcr to be able to perform 
secondary tasks alona with the data entry task? 


7. Will the overator te under unusual environmental 
stress? 


8. Who will the omerators be? 


9. How much experience will the operators have with the 


data input device? 


10, How important is -inout error rate to the application? 


How important is entry speed to the application? 


a 


No 


VOWELS which 
the vocai cnords. 

In english, 
and e2 different 


different phonemes. 


greatest difference 
approximateiy 680 (Ref. 
Speech ‘quality’ is 


thovaht of a8 a measure 


12. Ny)1l the operator be reanired to interface with other 
operators while Fe is tisina the jinout device? 
C. SPFECH RFCOGNITION AN AyERVIFW i 
i 
All human lang. : 2 eor5'3% of grounos of sounds called i 
a 
2 
phonemes which are - e tet bv the interaction of various a 
= 
a 
speech articulators: lios, toraue, teeth and palate. There : 
2 
are five, aenerally accepted cateaories of articulation H 
(Ref. % and 4): i 
1. PLOSIVES or SIAFS which act to stop the passage of ; 
aire such as ‘t' in “too”, ; 
2. FRICATIVES which are caused by forming a narrow slit i 
for air oassage? such as ‘th’ in the word ‘their’. 
3. (LATERALS whicn are fermed by closing the middle line 
of the mouth? sucn as ‘1° in the word ‘lauoh'. 
4. TRILLS which are formed by the rapid vibration of an 
articulstor such as the trillea 'r' Jin some ‘ 
langquaaes. ; 


are formed by unobstructed air flow 


there are about 
consonant variationss providina about 38 
Besides the aetual sound 
the different cateaories of phonemes, 
generated varies significantly from case 
allow much more power transmission than consonants, 


peing 


over 


lo different vowel) sounds 


generated by 
the intensity or power 
to case. Vowels 


with the 


28 dB - a 


” 
é 


about factor of 


31! 


a rather elusive term, but can be 


ities: pitch( frequency ), 


- 


of two qual 


ee 
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and louaness fpower). Intellioitility *s an even more 
elusive narameter. Tt varies with aualitv, context, 
vocabulary size and hackoaround noise level. Generallv, 
intelligibilitv 15 enhanced when the size of the users 
vocabu'ary 18 reduced, as 18 the case with air traffic 
controller-to-aircraft communications (Ref. 5). Both the 
pilot of tne aircraft and the contrelle use standara 


ohraseology from a defined vocabulary for the oulk of their 


transmissions. Alsor intelligibility is enhanced in this 


situation hy the expectation on the osoart of both 


participants = the controller and the oilot = as to what the 


other will save in effect, further reducing the size of the 


vocabulary. Aircraft communications also make use of 


another aspect of intelliaibility: that of improving the 


oower of the sooken sounds by using the 


phonetic alohabet 


instead of standard letter oronunciations or the use of the 


word 'roaer' instead of 'UK', 


Since human speech often is processed by electronic 


systems, snother factor to consider is that of freauency 


filterina. Some phonemesry such as the 


‘ssss' sound are 


sharoly affected bv filtering of frequencies above 4 KHZ, 
while most short vowels are affected by filtering 
frequencies below 1 KHZ. Althouoh freauency components of 


human speech vaty between men = and 


women, from werson to 


. 


even from day to day for a single person, most 


persons and 


are contained within the range of 490 HZ to 


r LO an ; 


4000 HZ. The 


th 
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hulk is hetween 1Kn7 and 3 KHZ [kef. 5].- Generally, 
filterina will not make speecn unintelliarhle. Nowever, wt 
will maxe it seem ‘unnatural’. 

The very nature of speech, with its rich endowment oft 
soundse inflections; moods and varietys makes it an 
extremely difficult modality to quantify. Lea (Sef. 5) outs 
it this way: 

"No two utterances are exactly alike, and the 
communicative ability of soeech is due to resemblance 
between successive utterances." 

Thuse it would seem that the real challenge of human 
speech eccrocessing hy nachine 15 to aetermine what features 
carry the information in sreech and then use them to process 
the utterance and decinher its ‘reanina'. 

Conceptuallye there are a numoer of approaches to the 
development of a human sreech erocessing machine (Ref. 51: 


1. ACQUSTTCAL SIGNAL APPROACH: treats the problem as 
purely one of determining the freauency spectrum of 
the speech input. This precess tes been enhanced by 
the cevelooment of the Fast Fourier Transform (FFT) 
alaorithm wnich allows a considerable time saving in 
doing the spectral analysis. 


2. SPEECH PRODUCTION APPROACH: considers the methcd of 
speech oroduction in humans and attempts to decioher 
tne speech by considerina the effects of vocal tract 
resonances, vibration of the vocal cordse and methods 
of articulation. : 


%3. SENSORY RECEPTION APPROACH: Suggests that speech 
covid be decionered by duolicatina the orocesses that 
eccur in tne ear anu the interpretive components of 
the brain. 

4. SPEECH PERCEPTION APPROACH: Attemots to extract 


features and make categorical distinctions that are 
exverimentally established as being important to human 
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ceerception of speecn. al} soecalleg vowe | 
distinauiskers fall into this category. 


Speech processina systems are naturally divided into two 
distinct catecories: continuous smeeck systems and isolatea 
speecn svsters. Tsolated screech systens aenerally deal with 
distinct utterances, tvpically of uo to two seconis in 
length (Ref. 6). Also, ost current svstems require a i100 
™S pause between utterances [Ref. SJ. Neate the use of the 
term utterance vice word, as the utterance may consist of a 
single word or a mhrase. isolated speech processors have 
found their wav into industry in great numbers. tJIhey allow 
a mail service emplovee to nave ris hands free to rroperly 
orient packaaes so that he nay announce their destinations 
to the voice recognizer. Thnev vermit ovaraolegics to use use 
voice-controlled wheelcnairs. Thev are used on oroduction 
lines anc permit user mnobilitv in performina auality 
assurance tasks. Most current isolated speech orocessors 
utilize a firm of spectral analysis to ‘recoanize’ the 
ineut. o. 

Continuous snmeech processing systems have an inherently 
more difficult analysis to perform. They must actually 
intercret the speken language. This is a monumental 
undertakina. tven if wa do not consider the oroblem of 
interpreting homonyms -~ words which have exactly the same 
sound - there remains the problem of defining word 


boundaries within the context of sentences. The boundary 
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sounds of a4 word are hiaohty ueoendent on what words occur 


immediately before and after it as it is spoken, Also 
contractions occur freauently, further modifyino the word 
sound. Tnus, the ohrase "would you aet..." mioht sound 
more like "wouja get..." wher actually snoken, 

The loaical follow-on to a system wnich could recognize 
continuous speecn would ve one which actually would pve able 
to understanru it. Tnis is another quantum lear in 
complexity. when humans communicate with speech, they use a 
complex, learned benavior which considers manv aspects of 
the incomina pattern of speech. A human considers the 
context of the utterance, tne task btirg performed and his 
understanding of Englisn syntax to form an expectation of 
what the words will be ang what tney should mean. Then he 
Derforms semantic analysis on his nerception of what the 
utterance was to determine if it makes sense (Ref. 4], If 
note the process is repeated. This iterative erocess is 
continued until the inout makes sense. 

Continuous speech recognition svstems do currently 
exist, and they do work. However present tecnnoloay has not 
been able to provide the execution speed nécessary es allow 
these machines to operate at anythino approachina real time. 
They may take many minutes to process 30 seconds of speech. 

Tt is certainly valid to ask why it is thatre given che 
difficulties involved, we continue to pursue the use of 


speech as an input modality. The answer has many facets; 
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some of which are more ohvious thar others (Ref. 71. First, 
it is speech which man uses in nis daily communications with 


otbers. Tnus it is koth convenient and natural. Tf 


artificial syntax or unnaturaliv restrictive vocabularies 
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can be avoiged, the speech input language requires very 
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Tittle learning or adanotstion as woult oe necessary with 
special kevnoarga coves. Speech is a very high cavacity input 


modality. lable | shows that tne dat3 rate achieved when 
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speaking non-technical orose 1s nearly twice that achievable 
by the skilieo tvpist. Using sneech, it is nwossivlie to 
communicate with otner peonle and the computer 
simultaneously. This tav have advantages in certain time 
critical anplications. 

A major advamtage of usina sneech input is that it 


allows the user unusual mohility. Since the input device is 


a micropkonre, aenersllvy worn aS an attachment to ai head 
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band, there is complete freadom within the area allowed by 
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the length of the nicrophone cord to move about a, work area. 


There is actually freedom to rove in any of the three axis, 


to any arbitruicy orientation. At the same timer the system 
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also allows supplementary tasks to be performed as the voice 


inout is being made. Certain, inouts to critical operations 


e — - 


may reauire verification before <continutng on to a 
subsequent ster. Generally, this would require two 


successive keyboard jiaputs. This orocess could be performed 


more guickly if voice inout was used as a verification or 
primarv command inout devices. 

Qne auite interestina aspect of speecn comtunication is 
that each person's voice aualities and manneris™s are auite 
uniques and mav be used to verify the soeaker's identity. 
The qualities of the voice als” channe for a sinale person 
from aay to davr in response tc stress, emotional conaition, 
colds and other factors, which may comolicate the orceb'em. 
However, aiven a sonhisticated enough eroecessorrs these 
chanaes could be usea dv a machine to tell its user that he 
has heen under too much stress ana that he shoula see a 
doctor and stop workina so nara: 

Nt course, speech inout is ot a panacea ang it has its 
disadvantaces. The constraints of artificial syntax ang 


hiahly restrictive vocabularies may outweigh anv claims to 


its heing natural, thus reauirine consigerable learnina. 
Backaroung noise can adversely affect the recognition 
accuracy of the machine. The individual differences in 


voice characteristics which makes it possible to verifv a 
person's identityse also generally makes voice input systems 
one petson machines. This is aeneraliv tranifested by the 


requirement for a training session, during which a 


prosvective user will soeak each word of the vocabulary up 
to 0 times. The results are loaded onto a cassette taper 
which must then be read by the machine orior to its use hy 


ary new user. 
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A teackrical censet cuklished in Septescer 1977 by 
Threshola jechknologvy inc. for the kore Air Deyeloomert 
Center, (Ref. 8) descrites «ork which compared the 
effectiveness at three Ayfferent input devices unger 
various conditions. [he three isout agevices tested were a 
common computer terminal, a Graf nen, ano the vIP 100 voice 


recoanition system ouilt cy Thresnold Tecnnoloay§ Tne. the 
Graf oer is a somewnat urusual devicerwnich is used in the 
Same ranner as the more rotern aigitizer taclet or CPT light 
3. it allows the ussr to inout a word bv touching the 
Sevice to the place where the word anoears on ai ‘menu’. 
The wraft pen differs from the more rodern devices in that 
it generates a spark when cressed acainst the menu the souna 
of which is receivea by sensors located around the 
oeripnery of the menu area. The sensors ailow the system to 
thus fix the position of the pen when it was pressed against 
the menu, thus, locating the desired inout strina. 

There were two catencries of tests used in the 
comparison: a hian speed <d3ta entry task and a high 
complesity data entry tas*. The high speed data entry task 
feauired subjects to enter strinas of characters as they 
were presented on oa Rurrouachs 16 character Self Scan 
display. Numerous factors were used as variables during 


this experiment, among them: 


1. Length of strings. : 
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Hang occupation 


The tyne of characters, ie. alohgnumeric or strictiy 
nuteric. 


Tne tang occunation task, «en used, consisted of the 
requirement tc sinultanecusiv depress tro cushbuttons 
senarated hy i4 inches cefore the reauired inout  strinos 
disolayed on tne Byerouths unit. 
results were categerized by factors affecting entry 
inout error 2 and oserationa! error rate 
measure cf errors remsinino after ti ooerator corrected 
ef his chserved errors. In this test, the keyboard was 
fastest device reauiring 2° percent less 
character than vsxice which finished last in speed. 
primarily a result of the mucn hiaher ‘inout error rate 
demonstrated by the voice unit - twice that of either of the 
other modes. Alonanumeric data required 25 percent more 


time than numeric entry for all of the devices and was 
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judged the most sianificant variable affecting data entry 


speed. There was no sionificast difference in the- 
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operational error rate among the various entry devices. The 
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most significant factor affectina the errors remainina after . 


correction was the type of characters used. Alohanumeric 


strings had negrly twice the error rate aS aure numeric 


strings. This was partially attributed to Treading oF 
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interpretation érrors such as Ra 3. zeto for the 


-Tetter 'o' or the number ore for 


eo? 


The secora general cateasry of tasts comorised 


called tna high conmlexitv gata entry task. ihis task 


simulated an air traffic centrol fliaht clan arendgrents ana 


correcticons scenaric. fhe desired ameniment was aiver to 


tne subjects in text forse and they were required to enter 


the change inte the syste. Tne subfects were first 


feouired to enter the catesory of the amendment 


flight, amend routins, MANDOFF a fiiaht,. etc) after shicn 


the System would oresent cromots to entain the gata reauirea 


to carry out tre request. Tne text of tne desired chance 
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contairsd al} of the information required to make the 


nt swat 


Chance. Howeve*, in the text version, ‘the data items were 


not oresented in the same sesuence in which the system 


Prompts requested the data. Thus the subjects were required 


to interoret the text version to determine the proper 


responses to the svstem oromots. 


The sigrificant variat*s3 included hand occupation, 
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subject experience with the entry device and number of 
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trials already completed. faaine factors affectina the 
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three cateaories of entry speeds operational error rater and 
input error rate were examined. the choice of entry device 
was a Sianificant factor in entry soeedy with the voice 
system and Ceaf pen not sigqnificantiv differents scout both 


about 30 percent faster than the keyboardeeven thouoh the 


keyboard users were’ permitted to se two-letter 


¢ 


abbreviations for the commands. 
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Fxoerience jevel, nonwevers 
variance in entry seed. lhe 
for inexoerienced kevooars 
entry device was 56 
Graf nen users using 
oerceént: and far inexneriante 
users, only © pesccent! Tht i wouls appear 
jrexoertencet? users of vol input i their 
data inout sceea with much is t ice thé inexperienced 
users of xevboard input. hot: n is is indicatea for 
entry speed only, The question of entry accuracy with be 
addressed sudsequentlv. lhe hand occucation task ceauired 
depressing pot of the pushouttons oreviousiv mentioned for 
3.5 seconds for each input tessace. AS mignt be expecteds 
this task affected the Graf nen users (33 percent slower) 
and the kevbcard users G6 percent stover) to a much greater 
extent than tne voice usersti® ocercent slower). 

Agains there were no significant differences between the 


entry devices in = derations} e"ror  -rate. 


ianiticantiy, though, the ouik ct the vaice syster errors 


were feceoonition errorsiie figh basic error rate) while the 
majority of the errors with the other two svstems were 


reading or interpretation errors. As a group, the 


inexperienced users of all three ingut devices suffered a 56 


percent inérease in ftotal s*ord errors after correction. 


There was gnificant indications cof férences in this 
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observation amorg the tnree innut eodes. Thus, it arpears 


with voice iscut a5 tne entry tore, tne error rate 5 ahout 
SU scercert higher renardliess of antry tode. Tne combination 
of tlsck of experience ang nand sccuration cic significantly 
incresse the ceeraticnal acrror rate, oristarily because this 


tendeg to increate the number of resding errors. ihe casic 


Thast that of tne other tan modes. This was cué to its osor 
recoanition performance and confusing e#rror correction 
Syste. The cerrection sytten allowed a bhac«space mier a 


orevicus character of an erase of the entire inout tne. 
Theres was Scme contusion over the meanina of the correction 
words, So that the ERASE commard was eccasionally usea when 
@ Dacksoace was desired, thereby requiring the entire lire 
to he reentered, Adaitionallv, the oogoer recognition 
bertormance led to numerous incorrect matches with these 


correction swords, causing additional confusion 


An FAA repert released in Aucust i979, {[Ref. i, 


a Voices inout syste® in ai simulated air traffic centrol 
environment. There were actualiv {wo exoeriments conducted. 


the first examined just the recoanition accuracy of the vIP 


100 voice recoonitisn unit manufactured by Threskold 
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keyset svstems, The secona exneriment comnaren the sneed 
and accuracy of the voices inout system with tnat of a kevset 
System currently 1m use within the air traffie control 
System. 

Tn the first experinent, an aperational vocabulary was 
divided into three sub-vocahularies: Message tynes(15 
worgos), Gengrachical Fixes{ 2] wards) and Diaits ang Control 
Words(!dc words). Mata for each of these subvocabularies was 
maintained separately. fhe subvocabularies were tren each 
expanged into ai list consisting of ten renetitions ot the 
member words randomly nositironed so that the Messane list 
contained 150 words, the Fixes list 219 wordss ana the 
Dianits and Control words i?t0. tach subject was required to 
read these lists during multiple testina sessions = ten 
sessiors for the Messaae ana Fix subvocabularies ana five 
sessions for the Control words sucvocatulary. 

The results of these tests demonstrated some interesting 
characteristics of the voice inout process. Considering an 
error to ve either a failure to recoanize an inputlie. no 
output strina) or an incorrect match, the Message 
subvocabulary had the hignest error rate with 3.2. Sencents 
the Fixes subvocabulary nad the next highest with 2.2 and 
the Diatts and Contre] words had the lowest with 1.8 
percent. The Message subvocabulary also was the first 
vocabulary tested, followed hy the Fixes vocabulary and, 


finaliv, the Control words votabulary. Thus- the subjects 
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tendeg to decrease tneir error rate as they aained 
exoerjience with tne svster., Tne droo from 3. percent to 
1.8% vercent renrasents a 44 nercent decrease in error rate, 
a figure wnich agrees closely with tne cesults of reference 
(Ref. 81 oresentecd oreviously. 

Tr 18 alsa important ta note the variabilitv im the 
error rate within each subvocabulary. There sare words in 
eacn which show error rates from one fourth of the averaae 
to four times or more of tke everane rate. Not shawn on the 
tables is the fact tnat the performance of individual 
Speakers Shows similar variahility. The individual sneaker 
error rates varied from zero to nearly 7 percent. From cne~ 
half to twoethirds ot the arrers reported for the most 
error-orone words were accounted for vy one cr two of the 
soeakers. 

The secone experiment was destoned to compare the 
performance of the voice innut system to a currently used 
keyset device in scenarios which simulate an actual ATC 
nonradar contrel position task somewhat similar to that usea 
in the HCDE exnerimert descrinea in reference [{Ref. 8]. Two 
sets of 100 realistic messages were constructed using the 
three subvocabularies testeaq in the first experiment. These 
two gfoups of 16 messaces were further aivided into four 
aroups of 25 messanes which were used as a sinale fun with 
shert rest pertods petween ~toups. The proportions of the 


various categories -of messages was carefully controlled to 
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simulate the anrorovyimate trix whitch Aa cantroller waula 
actuarily see while actuaily performina the nonradgar 
controllers position foh in an Fnroute Center. The order of 
the messages waS franyom, and text af the messages did net 
oresent vata in the Same order as the svster required it to 
be enterena. Thus it was mecesSary for ench of the operators 
to translate the desired entry into tne syntax which his 
entry cevice reauired ant order the data so that the host 
System wculd accert it. 

Five onerators particinated in this tests oniv one of 
whom had particinmated in the first experiment. Thus, four 
of the five had no exoerience with vaice entry devices ana 
reauired oasic trainina in the proner use of that system. It 
shoulo also be noted that tne kevset entry device did employ 
$0 calied ‘quick action’ vouttons for the most common messaace 
types. This allowed the entry of the more frequently 
encountered messane tyoes with a sinnle key siKotes All 
other message tyres «ere entsred usina a two character 
abbreviation. 

Data was collected on hoth data entty sseed and error 
rates for each of the five narticioants. Total errors were 
divided into three groups-accordina to their cause? 

1. LANGUAGE errors caused by usina an incerrect command, 
such as "droo track" on the voice system or *RS" on 
tne kevset instead of “cancel"™ or “CN" respectively. 


2. FORMAT errors caused by not using oroper delimiters 
or spaces between the narts of an input messadge. 
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3. CHARALTER errors caused hy recognition errors with 
the voice inout or xeystroke errors with the xkeySet. 
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Votce inmut deronstrated a significantly tower overall { 
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operational error rate, that is, errors ramaining after the 

i operator nad finished tne trial. Tne cverall rate tor voice 
Inout was Tess than nalf of that ‘for the kxKeyset. 
Cae Sianificantly, the voice input demonstrated its forte for 
easily handling strictly formatted outcut ov a formatting 

error rate of zero. fhe character error r3t2 was 25 percent 

Yess, ara the lanauage error rate was 66 nercent less using 

me voice inout. The fact that lanauage errors are three times 
more freauent usSina the kevset than they are using the voice 

System supports the concert of a ‘natural lanauage' 

advantage for voice input. Corrohorating aata was aathered 

on the ‘translation time’ for each message - defined as the 


time period hetween receiot of tne desired message by the 
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operatcr and nis first data entry. This rouchl)y 
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request into a syntacticslly correct system message. 
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~ Throughout the testing there remained a distinct advantage 


for the voice input in this area. Initially, the 


translation process took 50 percent longer with the keyset. 

: This advantaae continuea to accumulate until near the end of 
;F testina, as the users of the voice System became more adept t 
t 

a bi at using it, translation time was 100 oercent Ionger with 3 | 
i 


““ the keyset. Again, there was considerable variance in error 


a AD 28 


econ, SSL 


% 


TRE Sonate ate “STO 


fat 


wenn te eee he 2 meme eae re oe 


wir : xe 


endive ah wHlnlsene cess OHRGRRDLCE I RMELUONAHEN CINE A AH SUMING FELARAN DHNT Loy eS 


Mahe 


ee ee, <i = 


rates amona tne five oneratorSr with veice input showing the 
most extrere effects. Tre ‘worst! ones orndiucea an order oat 
maanituae more errors than the ‘nest’ ones. 

The results for tne ata ertry rates showed no clear 
advantage to either iaissut device when all of the input 
messages were considered, although the fastest rate was 
recorded ry one operator while usina voice inout, aro the 
Slowest rate was recorded ty one onerator usina the kxeyset. 
However, when the analye1s considered onlv tne types of 
messages which requirey short cormands and mostiv§ aigit 
entry, there was a 30 to 59 nercent advantage in entry soeed 
for the kevset. 

The results cf these two reoorts served as the pasis for 
the current work, The corclusione have provided the 
incentive to pursue 4 sractical aprlication of voice input 
technsloay to current Fleet orobhlems. A brief summary of 
these conctusions aonears belo: 

1. Voice input technoloay has been denonstrated to have a 
definite aavantace in data entry rate ano/or accuracy 
over kevodoardu devices for aprlications requiring 
substantial mertal or visual effort, or those 


reauirina tedious, strictiy formatted inout. 


2. Very hiah recoonition accuracy is possible with 
commercially available units. 


3. A users lack of exnerience aftects Tne data entry 
speed of voice input much less than it does kevboard 
input. This suggests that '‘'trainees' miaht achieve 
their maximur inout speed with voice input much sooner 
than they would witn keyboard inout. 

4. Discrete word voice recoanition units are not well 
suited for data entry tasks reauiring entries of larne 
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A data ertry agevice snould have ao simole,loaical and 


easily understood 
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The Tnresnold 449 16 a FWIScrete smeech recognition unit 
manufactured bv Threshola Technoloay Ine, Pelrare New 
Jersey. It has a votahulery canacity eof 25% utterances, 
each of which car he from 9.1 to two seconds in lengtn. A 
minimum tu0 ms pause 15 renuireg netween utterances in order 
for the sacnine to gefine speech boundaries. An operator may 
speak as rapialy as he desires, as there iS no requirement 
for nim to wait hetween utterances for the machine to 
complete procetsina on the previnus one. nowever, the 100 ms 
Oause must occur hetween eacn of the utterances. Processing 
time is denenagent on the size of the vocabulary fRef. 6). 
However, typical times are practically instantaneous 
averaging 259 ms as renorted by Ponck fRef. 107. ‘The range 
iS aporoximately 190 ms to 590 ms. Processing time may be 
reduced pry restricting the vocabularv search to any of uo to 
16 different sets of supvocabularies. [fhe words in each may 
be exclusive or shared atong any or all of subvocabularies. 

The system consists of an analog speech processor, an 
LSI 11 microcommuter with a digital inout-output interface, 
a disolav screen and xeyhoard, a microphone/preamo, and a 
cartridge tape drive. Tne speech processor and 


microcomputer are cackaged in a single unit atovt the size 
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of a small cuitcase, «which way be remotely locatea um to 
2000 teet from the cemeainina comronents. tlectronically, 
the svste~ ‘loors' like any cTA standard RS-e3eF or 29 ma 
current loan input aevice and its innout will appear tt) a 
host corputer like tnat from 3 common revvoaru terminal. 
Thus, there is no special orocessirga required of the output 
before 1t can he used ry the asst system. 

The soeech processor uses an undisclosed algorithm to 
extract the significant comoonents nf the snmeech input. Tt 
then converts these Mnighlights! immto diraital sianals which 
can ce oerocessea hv the microcomouter. The microcomputer 
uses another unaisciosea elaorithm to compare the sigitizea 
inout witn abat has heen stored in ats volatile 
semiconauctor memory. lf the necessary number or Quality of 
characteristics earee with anv of those stored for the 
vocabulary, a match is ‘teclareds and the predeterminec 
output str.ng of up to 16 characters +S transmitted to the 
host syster. Tf no match is sade, an audibte tone is 
produced to so indicats. 

Before the svstem is used, however, the operational 
vocabulary must be ‘trained’. [rainino consists of speaking 
each of the utterances in the vocabulary 10 times in 
Succession leavind tke  7initun 100 ms pause between each. 
The system must also oe given tne character strings which 
are to ove cuteut when a memper ot the vocadulary is 


recoanized. [These ovtout strinas are determined by the 


A Wa au 


LR MT TT FERC ST es ATTN. ye sc 
ene a nnn anton eneees my Jaen none encangeee 


I 


my 


mh 


] 
< 


ee one eT 


operater orice ts the system'« use and entered ance using 


the the tertrinal keyhoara, “Aen this nas heen completed, 
the contents of the ™pnicornouter core mernryvy wnere tris 
information is stored is read onto 3 cassette tane using the 
taoe arive unit. Tnis tust he done for the first user after 
a new vocahbulsry has heen established, Supsenuent users 
need only reag this master tape into the mactine ang perform 
the *ratning, after wnich their vocabulary is reag anto 
their tame far suosenuent use, 

Tne Threshold 609 has ten oneratianal modes: bufferea 
and unbuffereo. in the unbuffered mode, if the System finds 
a match for tne snoken utterance, the respective ecutput 
Strina is sent immediately to the hest. 74 che match was 
mot correct, then, of course, an incoeriet autout string is 
sent, without Giving the oaperator a cr-ertunity to 
intervene. This is comearahie to - Standard tyoewriter 
which outS a character on the paper as soon as a kev is 
Struck. At this onints anv error correction is a function 
of tne host svstes. Tf no sucn errors can be tolerated, or 
if error correction on the host System is oarticularly 
difficult, the ouffered node may be used. in this modes the 
T-609% acts like a standara terminal which allows you to 
check your input ano nake anv necessary corrections before 
you send the inout to the host with a ‘CARRIAGE RETURK’ ap 
"ENTER'. «Tae T-60% permits up to 128 inouts to be stored in- 


the buffers then sent in a olocx mode with a single transmit 
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comman’, Two correction routines are availanle in the 
huffereg mace. ere alloxs tne crevings outmut strinnas 
(which are stir! in tke cuffers ta re sequentially delete, 


The seronij geletes the entire contents of tne buffer. 


RL THE Si¥vulaTioe 


This section oescrices the sinulation useg in evaluating 
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voice any keyset incut for the TACCM orefliant data entry 
task in tne F-5f aircratt; nmeainninea «it some aeneral 
consigeraticns, orasressina to the “araware usedr and 
finishine with ai seserictisn of the simulation oroorar 
itselt. 
. The Purpese of the Sint lation 

The pure tse 2f the sirulation rrogram is ta erovide 
a means ty which the performance of a voice input device 
could ove evaluated usine an operational vocabulary to 
nertacm oan artnal  onarational tata inout function. The 
function chosen was tnat of TACLA rreflignt Gata entry in 
the P-3C ASH natrol aircraft. The soecific tasks involve 
entering typical preflight data into the STORES VANACEMENT 
and AVIGATTON PReFLIiceti tableaux. This reaulres the 
Simulation to disolav those tableaux, as well as the INDEX 
tableau and to nandie the interactive exchange of 


information by an operator simulating the TACCO's data entry 


functions. 
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necessarv far tne wtonmras to collect sertinert data on 


Subjects! oertfarrance of the tata entry tases. A nurper of 


possinle treasures af effectiveness (Mt 's) were considered. 
Two, however, were justet tost relevant ¢ accuracy ara entry 
speed; ara the simulaticn rroaram gathered necessary 
Statistics on rnese *strics. 
2. Simulation vescripztion 

Three tableaux from the F-=3C onerational software 
are functioera! in the sivtulsation: TNPEX, sTUuRLS VANAGEMENT 
and Mav PREFLIGHT. Tne TEEEY tapnleau is disclaved on a 


Standara vider terminal crt when the simulation is first 


calleg up ~ see apoergix «, The I*OFX tanoleau is a complete 
reoresentation of that fourag ir the actual aircraft as every 
tableau availanle to an oapverator in tne aircratt is 
presented, From the TROE¥Y, tne simulation allows tke 
operator to select either tne STIRFS MANAGEMFNT tableau or 
NAV OPEFLIGHI tableau ov enterina the aonroprisate line 
number ~ see aopentix A. 

Once the desireco tanleau is disolaved, the operator 
has a number of tunctions availacle to operate on the data. 
A next line function oxavined means hy whien lines in the 


tableau may be accesset sequentially. Any incividual line 
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may be accessed usina an enter lines number function. A 


‘Subsequent cage of the STORES MANAGEMENT tableau mav be 


displaved using the next ceae function. Correction 
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functions permit ge BAFASESCF to the oo, rviorsly entered 
Character - aS with an orainary tyrewriter 7- or a Delete 
LINE , whieh allans deletion of the entire string of erteredg 
Characters, cermitting reentry of correct tata. Alerts are 
Presented to inform tne operator that an invalid line numver 
has been requested, tnat the currert tine kas no modifianvle 
Characters in ity or tnat the current line is the last line 
of the page. 

Tne simulation also collects gata or a nmumper of 
imoortant factors uset in retersinina «he measure cf 
effectiveness of the two input vevices. The time reauired 
to enter the test data is maintaired secarately for the 
STORES MANAGEMENT ant VAY PREFLIGnT tableaux. This time is 
measures as the sum of tne reriods between the time the 
cursor is oroperly ocositioned - readv to accept input = ana 
the CARFIAGE RFT'HNRN is sent. Tne nurser of times that the 
MELETE LINE ard B8ACKSPA4CF functions are used for each 
tableau is also counted. Tnis is later used as an indicator 
of inout error rate. #nen the simulation rune consistina of 
data entry for the two tanleauxr is comcleteds the data itn 


the tableaux, as enterea by the cperatsr, is ptaced in 


ai 


UNIX file for sybseau2ent avaluation of operational error 
rate py the UNTK utility "RIFF". Alsose the entry timess and 
delete line/packsnmace counts are displaved on the screen ai 


this time. 
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Tne system gescrictisn,s 


general, ‘9 orrvide én overvier of its canshilities. the 
follonine few saratrachs wili moresent tre Funan factors 


aseects of the svste7 in sorenkat tore adetai’. 
The ftuncticorts avarlahie tea the operaioer are 
igentica} for fFotn af tire tanleaux. Zhen the requested 
3 7 


tableau is aimitiality oresentet, ne first lire with 


modifiaole inforsation - the orompt Tine — is tisclaved at 


the next line directiy velow the first moaifiatle character 
ef the crompt line «aitina fer gata input. Tsis is s 
slightly jifferent - atthous® functionally eauivalient = - 
cresentation from tnat in the F-3C aiscraft. That system 
places the cursor uncer tne xsoaifiatie characters of the 


actual line in the tanleaue. thus writing over the orevious 


datas as the cursor skics over anv non-modi fiable 
charscters. In the actual svstem, thene, there is no 


sevarate prompt or incut line. This is nat considered a 
Sianifican: departure from fidelity to the P-3C systems 
althoush during tne simulation trials, subjects with 
previous °-3C axserience did oxoress a creference for the 
method used in the simulation tecause they felt it sade 
spotting errers easier. Durirg the initial 2s5ianr ohase of 
the sisulation deveioowent. fidetity to the actual systems‘ 
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tidelity to that syttems* capacity ta handle 
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than t.e DELETE LINE (CA™MLFLY function ‘nm the aircraft which 
deletes the charact2rs ertered for the line and terminates 
the sata input functioan. Tne sirrecratt function then 
reauires the orerator tn reenter the input mode if 
additional changes are uesirea. 
3. Haraware 

The simulation nardware consists entirely of 
@quloment operated by tne Naval FPostaraduate School Computer 
Lahoratory. The maintrare cemcuters were PGP 11-S0's 
manufactured by Digital Eauinorert Corporation. The terminal 
was a Standard DY 2590 intellicent terminal ranufactured by 
Datamedia Caornoration. the moagel variant used consisted of 
Separate keyboard and CRT units which mermitted the C8i to 
he offset from the keyboard, Tnis nermitted duplicating the 
aircraft confiauration where the CRI ‘*‘s offset vertically 
from the xeyset. 

G. Simulation Software 

The simulation software was written by the authors 
entirely it the "CC" proaramming lanauage. The supporting 
data retrevial macros were written for a PWB/UNIX version 6 
time sSnharina operating systen - whitch also was written 
primarily in tie C Varoauage. while the question of a 
language for the simulation orogram was first being 
conSigered, it became apoarent that the oroject called for a 
structured lanquagé, one well suited to moaularized 


programming techniaues. Neither of the authors haa an 
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extensive oacraround in the veneral aiscinlines of computer 
science, or the specific aree orf developina interactive 
computer orogramns. However, they were familiar with the 
Pascal proaramming lanauaae and many characteristics of that 
languace ceemed well suited to the requirements of the 
simulation - particularly the record end scatar variable 
constructs. Pascal was later rejecteo because of 
undesirable inout/outout and fileshandling idiosyncrasies of 
the available comviler, C, then, aoneared as a likely 
candidate for the simulation orcaram lanauage for a number 
of reasons: 


Tt is a structured language with Psescalimrecord-like 
constructs (structures) 


Tt interfaces easily with the operatina system 
It easilv supperts interactive oroaramming 
Tn addition to the obvious goal of simulatina the 
data inout functions of the P#3C software, there were a 
number of other ideals to which the authors strove in 
develoning the simulation software. From a personal 
viewooint, it was stronaly desired that the program be 
*readable’ with no ‘magic numbers' (mysterious constants) or 
tricky code. That is to ssv+ since neither of the authors 
had any previous exnerjience in C orogeamming, they wanted 
the code to be easily understood and “debuagable". This was 


accomplished primarily through the use of comments shen the 


pufpose of the code was not obvious, the liberal use of the 
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DEFINE statement *9 set values for constants or create macro 


functions, ana a strict rodularity which aivioes the proaram 


into discrete functional elements. 


After performina some initial tests, it hecame 


ical area of ths simulation which had 
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obvious that a cri 
formerly not received any consideration was the problem of 


‘real time’ orncessing of the screen data on an occationally 
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heavily loacea time snarina system. More ssecifical 
tableau had twentv-tnree lines of data to oe written to the 
screen (twenty tavteau lines olus alert line, promot ‘ine 


and input ‘tine hlanking - see anppendix 4.), and even with 
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the terminal ooerating at 9000 baud, writing each character 
on each line every time a sinoale line was modified, or when 
a NEXT LINE request was sent was introducina unreatistic 
delavs waiting for the system to write the tableau to the 
screen. Direct cursor addressina, 4 technique which is 


apparently used in the aircraft system, was initially 


pupae 


consider. ; but rejiecte#a as it was believed that this would 
make the simulation denendent on a single type of terminals 


and 1% was desired to make the simulation as hardware=- 
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indewvendent as possible. 
Tne solution «wss to restrictr to an absolute 


minimum, the number of lines written each time a command or 
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data wes entered. Thus, when data is entered to modify a 


line, a maximum of three lines is written to the screens the 
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modified lines an alert if necessary ior removed if no 
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loncer necessary), and a new oroamrt tine. “inen a NEXT LINE 


or a sescific line reguest 16 sent, 3 vaximum of two lines 


is written: an alert if necessary (or removed)+ ard a new 


i 
promot line. All other lires ce-gin cdtisplaved, unchanged. P 
Of ceurse, every line of a tanleau rust te written when that 
tableau is initially disnlayes, or when, for the STARFS 
MANAGEMENT tableau, ai 3EXT rAGF request is nmrocessed. | 
| 
However, this Scheme nermits aata entrv at a normal, ‘| 
unrestricted speed under all but the most extreme system | 
loads. i 
‘. 
A orogrant listina follows the apoendices. For those | 
who are more interested in a furetional descriotion of the 
simulation proarsm, 23 o3eudorcode outline of the major | 
routires arcears i Sorersic« -. i" : 
C. THE EXPERIMENT | | 
The obiective of the e-nsrinent was to evaluate the use H 
of voice recayifion as ar issut modality for oreflight data | 
bei | 
in the P-3C ASW aiscraft considerina the SOE's of input [| 


speed and accuracy. 
1. Desion Considerations 
Figure 1 shows the exoerimental desian graphically, 
a treatment by treatment by subject approach. There were, 
in fact, two such exoeriments: gone for the Stores Management 


tableay data entry task and one for the Navigation Preflight 


tableau data entry task. The experiment was desianed to 
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fequired for training and verification of the vocabulary. A 


Simulate actual software anc harqware confiourations of the 
Pe3C aircraft, soecificaliv the Tactical foordinators 
position during oreflight. Ine TACFU corrunicates witn the 
computer through his Matrix select switches and Matrix 
readout switches for tactical cortrol of his Multi Data 
Displav, and throunn the TAC xeyhoard for control ana 
viewina af Navigation catar Tactical sto-es, ana 
Intelligence data available via the 429, Since a tactical 
simulator was not availsbie for use in the conduct of this 
experiment it was not feasisle ta evaluate the veic- 
modality to control a tactical cisplav and the dynamic 
interactiors involved in so doina. The availability of the 
equioment in the Naval Postaraduate School Computer 
Laboratory allnawed the desian of simulation for use in 
inouting data into tne crefliant tahleux of the P-3C. The 
Datamedia Elite 2590 CRI was used as the disolay device for 
hoth the keyset andi voice recoarition methods of entrv.s 


Durirg the keyset entry trials the display console was 


Ohystcally separated fron the subjects which required them 


to physically move their heads in order to verify a “dats 
entry. The sevaration of the console and the keyset equates 
to the separation of the [ACCU's keyboard and the ARO in the 
P-3C. 

The vecabulary for the voice input unit was 


restricted to 61 entries in order to minimize the time 
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complete saperational vacabulary woulo fave 149 to 150 
entries. Restricting the vacaoulary to Al entries 16 not 
consigereg to have aftectes the proressina time of the 
System, 8ecal!l from section Til tnat other investiaators 
have indicated that the Jlarner vocabulary would not he 
expected to cause noticeanly lanser oracessing times for the 
voice Frecoanition unit TPoock, Ref. 103, Howevers the 
effect that aiolarcer vecabularv w«woule nave on the 
recoanition error rate is not known. 
°?. Subjects 

Thirteen subjects carticipated in the exogeriment on 
a volunteer hasis witn no monetary incentive. Thev inclucea 
twelve male officers and one female officer from the Navy 
and Army, all ef whom were students at the Naval 
Postoraguate School. Five were enrolled in the AS 
curriculum, seven were enrolled in the Unerations Analvsis 
curriculum ana one was enrollea in tne Comouter Science 
curriculum, Military experience leveis ranged from 
Lieutenant to Lieutenant Coemmanser in the Navy and Captain 
tn the Army... AlY subjects had previcus exoerience with some 
type of keyboard input to 8 computer svstem with experience 
level rangiag from novice to oroficient. Four of the 
subjects were eitner P-3C or S-5A TACCO'S and had previous 
experience with the oreflight data entry task of the 


experiment using the manual keyboard entry method of either 


the P-3C or S-3A. Only one of the subjects had ever used 
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voice recoanition eguinnent. Tne other tyeive nad neitner 


seen nor used voice recomnition enauinoment before. 
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Materials 


Materials usea yuurine tne conduct of che exnerinent 


inciluged: 


A tyning test wiics was use3 to determine a subjects 
skill leve? tn usin a staroart tynevriter keyboard. 

* guide for using tne varice recoonition System 
fanpendtix © 3. 


4 situtation overview fanorndix * J} wnich described to 
Subjects, the ercfective of the experiment, the 
simulation that «as to re useo » alertsrentry commands 
and errectiong. ant a cony of tne tableaux that were 
to pe modified. 


A simulation ftariliarization (apnengix t ) which was 
desitmnes to vive eacn supniect tine to vecome familiar 
witn data entry into the simulation. The aoal of this 
aprendix vas tc alioxr suniects to read and onysically 
enter reoresentative gata into tne simulation using 
rorn voice and kevorarg innut moacalitv. It also 
aitowed subtects ts practice usina correction 
Oroceaures fer the sinulation. 


Preflicht data iapreraix Ff ) which consisted of three 
arfferent dats sheet 


on 
oer 
ont 


Ravigation Preflicht datary which was used to fill 
in the “Maviaatirn Prefliaht tapleau. 


(2) Voice Sanstouy Status Chart, which was used to 
fill in the Stores “ananement tadleau using the 
voice toedalitv. 

£3) Keyhoard Sanobouy Status Charte which was used to 
fill in the Stores Manacement tableau using the 
keyboard trodality. The oniv difference between 
the voice ang keyooard Sonchouy Status Charts was 
the use of the synbois for the deoth and life 
settings of the sonohouvs. For trials where 
voice was the input moualitv, the depths (shallow 
cr aeeon) and the tife settinas (short or ltona) 
wete spelled out. For kevboara triais the deoths 
(S or 6) and the life settinas €35 or 13 used only 
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the first Tetrer cf the acrds. xvbhole words were 
used for tne Voice Sonobouv Status Chart to avoia 
confusion oeteeen shatlow ana short which might 
otherswzise cerunr vrren usierg 3 for the svnbol. 
uther thas these rinos agifferences hotn Status 
Charts cortaines tre sane data. 


“ voecahulary list farmencdix G1 wnich consisted of the 
il words used to inout data to the simuiation orogran. 
ne vocabulary aas xest at a mininum lenathk so as to 
eeo t'e amount oat tire spent in teainina the 
thresnalda 409 as lawn aS was practicanpie while still 
tTagintainina ontiznur usa ae of voice technaloay. The 
vocakulary list bas tnree cotumns of informatian. The 
*ORD Mu. colurn is useG to communicate with the f-o00 
Tne PROMET ecniurn contains utterances that eacn 
Subject trainec ane ysced wnen inoutting data to the 
Stmulation. ithe thiet column headau AUTPIIT cortzins 
characters tnat are sent to tne Daranedia 2500 for 
inout to the situlation proaram, For example worc 
rumber 16 requires the subject to sneak the utterance 
“ten inna". This utterance, wher recognized oy the 
T=600 will seng the outout ‘xxxlOxxxi' ("*" gefines a 
Flank space) te tne Uatamedia ?750u. Tne utterance 
Sévs to sera three sraces,a ten, three soaces, ana the 
Vetter L whicn stanas for "Iona" to tne Datamedia 2590 
for inout to the sinulation tableaux. 


S number of forms were used to record each subjects 
deta dutina the experiment (avvendgix H ). These 
included? 

Cit A Voice Recegrition Data sheet for each trial 


atere time and error data were recorded. 


f2) An operational error sheet tnat «as compiled by 
the UAKTA system which comoared the data entered 
Dv eacn subject with a master file of tableaux 
contents resident in the UNTX memorv. 


(3) A manualivy kceot log of T+500 recognition errors 
tor 2gach voice trialsand, 


€4) A Voice Inout Exnoeriment Questionnaire «hich 
solicited general impressions of the voice 
recognition svstem usefulness and expectations. 
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Tne OPxMeriment was fem an three staaes . Rurinag the 
first stage or meeting subjects met isaivigually with the 
experimenter arg were saiver a five minute tyoing test. Tney 
were ‘then civer a set of fariliarization materials which 
described tne curpsse er: the exoerimant, q0eration of the 


voice recognition svsten comands necessary to use the 
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Simulation, and 2 cony of tne System Faniliarization handout 
wnich they woulu later use wring a systen tamiliarization 
run. They sere then triad how the voice recoarition system 
workeg ant given = canv of "Using The Vores Kecoanitian 
Systen". Tne exnerimenter snowed each subiect now to wear 
and use tne neadset nicrornone and how to effectively use 
the voice systen. rellowing thie hasic familiarization each 
Subject was iven the vocabulary fist and trained the 
vocabulary under the aquiganete and monitorina of the 
exoerimerter. 

A readina nf cackaround noise level - in DRA « was 
taker, during ihe training session and entered into the 
Subjects "Voice Recognitinn Fxoeriment Cover Sheet" for 
later reference. £ packeround noise level reading was 
obtained each tine subdiects nrerformed a voice entry trial. 

After completina trgininn of the vocabulary each 
subject spok. each of the 61 words four times. Tf che Testy 


made a correct match for three of the four utterances it was 


considered that the word waS oroperly trained = for 
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recoanitior. T¢ fewer ttyc tare> out af four utterances 
were correctiv mattnet ‘sean tae sSuojiect retrainet tnat 
Particular wore. This firsre sessintnr Byvecaned one and one 
half nours in lenctn. 

Ths second 57°C trnird Stades af tke expearinert 
Tecuirec the Suciects to fil’? ir the otores VYanaaere.t ang 


Nav Prefliant tablesus nith cata. Facn suriect was ceauires 


to f47] in tne tablteauy «with 4gra cantainec on tne data 
Sheets in aorensi« F. lhev warr reguiret to enter the data 


twice fer each Trials once using yotce and ance using tte 
keyoraca etry mettod. Ihe surierts were randetiv solit into 
two enual groupes. “Ine orcun rerferred tne first run of the 
Tria! usine voice fneur. Tne anther sroun used keyboard = tor 
the first run of tne Trial. For tae second trial tre orger 
was reverses. fhe exrorrizent was eum es this fashion f6 
counter the effect of learning or speed and atcuracty. 

Tna subjects returned for tne secona stage ovetween 
one ard three gays after corpletirg session ore. This aare 
them a chance to look aver the famiiiarization material. 
The subjects stenred through the familiarization oroecedures 
during the first rnalf mour of the session. Surina@ the 
resainingo 435 minutes the subietts executed the first trial 
of the experiment. Facnr trial consisted of cerformina tke 
task af estering orefliaht data into the Nav Preflight 


tableau and sonshouy inventory inte the Etores Manaceszert 


tableau. Both che kevset and voice sodatities vers used 
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A, ENTRY SPFLO 

Takio Til o1ves a Sutsary of the mean entry times for 
the two tableaux by tria!s, and entry method. For eacn 
tableau, there w4s a significart ditference in entry time 
both between the trials and entry nethoa. the statistical 
treatrnent is shown in tables LV and V. Figure e& compares 
the entry tires on trial ane sna two for tne Stores 
Manaoement tapnlear. Ine xeyset was 9.1 percen, faster on 
trial ¢ and the voice was 17.6 percent faster on trial 2 (p 
< 0.01). Tne AYNMYA Yngicates no sianiticant interaction 
between trial anc entry metros. Figure 3 shows the same 
data tor the Navigation rrefliaht tahleau where trial 2 
times were, 30aio, taster: cv tl.o overcent for keyset and by 
5.4 oercent tor voice ir <« ,15). There was also 4 
Sianificant sifference in speec oetween the entry methods 
for the two tabieaux. Figure 4 shows the comparison for the 
Stores “anagement takieau, where voice entry was 9.7 percent 
faster than kevyset entry (ce < 0.1). Figure S shows this 
data for the Navication oreflight tableau where the keyset 


was 14.7 nercent faster thar voice entry (p < 5.013. The 
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reversal fastest ertry method between the two tableaux 


probably reflects tne characterety-character inout required 


for voice input in tne Naviaation Preflight tableau and the 


multiple character ouwteut use of voice for the Stores 


Management taoleau. 
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Manacerent tanlieau cata entry times, although nao such 


difference could be found for tsavication preflight 


data. Since each suoject nad been csiven a typinc 
was examined for any difference between the times recorded 
for the fast typists (qreater than 306 4PM) and the slow 
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recordea on each supjects’ warfare spec 
contained 4 officers (subjects 1r4e5 and 13) who had 
previously qualifieo as Tactical Coordinators. This aspect 
was examined and a sianificant difference was found between 
the times for the TACEP group and ‘others’ group. The 
statistical results sre shown in table vI. On erisl two the 
TACLOs' mean time was 23 percent fatter than the ‘other’ 
areup (o < 4.1). There wes no sianificant difference 
between the crouns on trial one, ocossibly because everyone ; 7 
was still learning about the simulation at this points 


There are some adoitional factors tc consider when : Ly 


o 
“ 
+ 
ch 
a 


evaluating the entry speed data for the keyboard. Not 


the reoroduction of the Stores management tableau data in 


ee ee ae) 


appendix F that there is a pattern in the data. That ise 
for a number of consecutive lines, the sonobouy type and 
hydrophone depth setting remsin the same ( as in "41 DB"), 
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"TWENTY OWF SHORT." Sirce tne thrust of tne experiment «was 
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utterances for which an errer rate areater than two percent 


> was recorded, Note that orlivy etoht utterances - 13 percent 


of tne vocabulary - accounted for 71.9 percent of the entry 


errors, and only three words - 5 percent of the vocabulary - 


accounted for 41.2 ocercert of the entry errors. A cursory 
examination was made cf fhe recognition accuracy for the 


troublesome utterances witn the numbers sooker as 


instead of “TwWENTY-T#O" and “GNE-STA" vice "SIXTEEN" ete. 


ot 


These preliminary investigations indicated that the 


edn esq pH me 


TAste XI 


NTTERAMCES wTT GREATER TRAN 2 PERCENT 
PECUGANTI Tu FRRUR PATE 


4-0 TUTAL 
NT TEP ANCE RASIC ERPUPRS > UM S§ 


De Rete oe Reet ee ee ed ee ee eee oe 2 eee ee ee ee ee ee ee 


2e SHCRT 17.6 * k * 


17) LONE 5.° 
20 SHORT 3.3 
18 LONG 266 


TSTALS 3: 7i.9 % 60.1 % 41.2 % 30.5 % 


SEBO OM OWENS OEE SESH SET NHB SBT TSBM SENET ee we 


recoanition errer indeed lower usina this 
tecnniacue. complete ist of recourition errors recordeg 
over tke course of the entire exneriment etpears 1m avpnendix 
T. Tne first section lists the utterances in the 
vocabulary. with all cf the incorrect matches recorded 
lhe second section tists esch incorrect match ano 
vocaoulary utterances with wnick each was incorrectly 

&s a consenuence of tne mrontem encountered with these 
few utterances, after the first few subjects had comoleted 
their first voice innut trials, a channe was made in the 
experirental nrocedure to prevent this from piasing the 
entry tine data. Tt an error occurred ana the subject 
caught the errcr, ne was civen an orpertunity to delete the 
line era reenter the data correctly. Tf, on the second 
atterot, anotnear receanitien error occurred, and the subject 
realizea the error occurred, he was told to pass on the 
incorrect data ana continue. These ‘recognition passes' 
occutred in 6.6 percent of the voice entries, although they 
dyd onct occu on any trials oerformed hy the ‘exoerienced' 
voice entry users. 

It ts likely that entrv errors affected overall ote 
entry sneed to ai greater extent than thev affected the 
keyset entry sceea, carticularly with the Stores Management 
tableau data. Entry errors in the Naviagtion Preflicht 
tableau were rather auick to correct with the ‘'BACKSPACE' 


function on either unit, since both svstems used a single 
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output or enter a NELETE LINE cornand and reenter hoth the 
correct and incorrect outeut om the line. Since the later 
option was aviccer -* it took five tm seven seconas on the 


average ~ it was the preferreg tetrkod and was enccuraced. 


ere y 


Corrections on the keysot were much fasters ana were 


aenerally made with tne RACKSPACE key since it coula ke 
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activated very raviagly. with these corsiderations, it seems 
reasonable to corclude that voice entry times would have 
been considerahiv faster if the numper of recognition errors 
could nave beer reduced for those eight troublesome 


utterarces. 
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z TACCO's miaht have a lower inout error rate than the ‘other! 
aroup because of experience aained in talking on aircraft 


radios. However, when this was examined usina the 


Hine ged weather 
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Navioation creflioaht tavleau entry error data, no 
siaqniticant tifference coulg ne found. “Whether this «was gue 
to Sore mf the ‘ather' aroun haevina similar exneriencer with 
bric e@ ratios, for instancer or whether the premise was not 


valid is not known, 


MN, FrOERLFNCE aTTH VulCF TNPuT 

Tnis cateaorv arose from the examination of the dat 
after the exvoeriment was concluded. Jt had not been 
considered in the exrerimental desiaqn mrrimarily because of 
the oitficulty in acauiring volunteer subjects with voice 
input exoserience. It hat been assumed from the start trat a 
person familiar with voice entry would be more effective 
than soreone who had a total of only 3s half hour's 
experierce witn the syster, as did twelve of the subjects 
when thev started their first trial in this experiment. 
Roth cf the authors had used voice inout curing a orevious 
voice entry eraject. ne took part in the compiete 
experivent(suoject %¢3) and one comoleted only the voice 
entry trials. Since two data noints do not make for very 
cood statisrical inference not much can be said with 
statistical sianificance ehout the following comparisons. 
However, tney are oresentead hecause they ao orovide some 
insiont into the capabilities of the vnice input svstem when 


used pv reasonably experierced personnel. 


74 


Tae oe 


enn) ete YN YH 


etme ween aN 
eonaomonetesnns sn 
ovquenessnnnnstune 


nna TANII 


Tahle XiT summari 
exoerience with 
tableau, tre two expe 
a 3n 


eercent faste 


entry tines amonn tne 


voice 


zes tke results for hotn 
entry. For the Stores Yanaaenent 
rienced voice esatry users deronstrated 
cf mean entry tire. The aistrircution cf 


14 suniects aomears in figure 6. Note 


that none of the inerperienced group nad entry times as fast 


or faster tnan the e 


in figure 7. 
of 1.%5 oercenty, w 


average of 1.2 percen 


Qne of the most interestina 


Spectacular increase 
oreflioht tableau dem 
input users. 


Preflioht tahleeu ent 


Tne exneriented users had a inout 


Fiaure AR 


experienced users, 


nich is annrnachina the overall keyset 
t shown in table TA. 


results, however, is the 


in entry speed for the Naviaation 


onstrated by the 2 experienced voice 


shows the distrivution of Nav 


ry times Py exnoerjience level. Taple 


X1I- shows the mean entry time of the 2 experienced users to 


be 48 percent faster 
This meaner, at 394 
fastest kevset time 
percent faster than 

of 608 seconds. This 
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advangateous (for voice inout) 


than that of the inexperienced aroup. 


seconas, is slightly faster that the 


recorded for that tableaur, and 36 
the mear kevset time lover both trials) 

sugcests that voice input may be 
than keyboard insut even for the least 


circumstance of character- 


by-Character dats input. 
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Ty. LANCLUSTUNS AND RECOMMENDATIONS 
ca eee a 


The exneriment was aesiunedt to test tne “UF'S of entry 
speed and aperational error rate oetween voice techniaue and 
keyocara technique for preflight data entry into 


ASW aircraft. 


CORCIE USI ONS 
The conclusions would be less tnan corcelete if mention 
acain maye reouragina th: exrerience levels of the 
test subiects. All of the subjects were fariliar with ang 
had used xeytoard entry systems orior to the exceriment. Tt 
must be emohasized that the subjects were very inexperienced 
with voice entry techrinues. Even after the exneriment was 
concluded tke amount of ti: f test subjects had 
accumulated or the T6000 was one ang one~half hours, which 
inclugeo the time spent training the vocabulary. The two 
experjences users were not experts in usina voice systems, 
but as me-‘toneao earlier hag comoletea 2 previous exoeriment 
usina tne 6-400, 
When ceterminina conclusions of the exneriments two 
factors must Le consiger.d. these are? 
1. The type of voice data entry: which was either 
multiple charzcter input for the Stores Management 


tableau, or charactureby-character input for the 
Navigation Freflight t wwleau. 


2. the exnerierce cf the users. 
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Rased on the rasuits t Stares Manacemant tableau, 
proficiency of the users, ag SuNjective remarks received 
from the test subjects com tne rost-ervperiment auestionnaire, 
it waS concludea that veice antry of ore-flight cata into 
the Pet weapon syctet nas faster ard fatiauing thar 
keyset entry. Additionally, with increased exoerience usina 
the voice syster, the ease of data entry and speeag of input 
could pcecone more oronounced as was ohserved with the two 
experienced users of the Tot, 


t 


Raset an the results cf the ‘eviastion Peeflight tanbleau 
the voice rote was sianificantliy slower than the keyboara 
mode. [this has heen torne out isn crevious literature with 
the conelusion thet characterccvechnaracter input favors 


kevDoard 2ntry methotis. However the experienced suojects, 


usina tne voice todality, atle to comolete he 


Naviaation Prefliaht task e Har e xeyhoard entry 


times of , of the inexperienced subjects. As a final 
conclusion t can ke state? that even in 3 task which does 
not favor the voice rode of entrys such as with the 
Naviaation Preflight task, an oexperiencwd user of voice 
Systems can inout data as fast or faster than standard 
keyboara methods, and with an intut error rate that is 


comparable, 
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RECOMMPANDAT IONS 


To effectively imolement 6 voice svsten for a otlatform 


such as the ©3430, it is recomrencted trat the aesigner: 


Tee 


“by 


Fxamine tne task in wunich tne yoice systen ig to he 
useJ. 


Netermine tne vocabulary that is uset ty the ore aters 
when engaged ir tne task. 


Nesian the voice recognition vocanularv to equate with 
the natural vocabulary ef crerstors when enaaaed in 
the task, 


Test the vocabulary in omeratinanal scenarios to 
determine tne set af frequettly t1issrecoanized 
utterances. 


Retrain the orovle™ utterances. 


Tf retraining does ast siunstantially reduce the 
recoanition errors, tnen «asaifv the utterance, keeping 
modifications close to the jsraor of the onerators. 


Netermine oonulation size of the onrerators for 93 
eerticuiar task. The smaller tne oosulation sizer the 
more tailored tha vocabulary can se to tre inaividual. 


Some considerations wnen anonlyina current voice svstems 


to the P-3C3 


1. 


2 


The vocabulary must he traineg in the backaroung noise 
in which it 18 intensed to be used. The recognition 
error rate of the T-400 is low asc leng as it is used 
in the same PsA level and background freanuency 
spectrum as it was trained ine Tt the difference in 
the level of hackaround noise 1§ oreater than about 7 
DBA from that in which it was trained, the recognition 
error erste will enon. an increase ([Pef. Li}. 
Crewmembers need t* comnunicate with each other over 
the TCS thus causing some oroblers in desion of a dual 
communications svstem, 


Voice [Inout is not the cest inout metnrd for all 
cases, thus the freauirement to maintain the current 
kevboard and matrices. 
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Tris exoeriment kas shown that for @ smal! wcortion of 
the Pes mission tnat voice entry was ore etficient than 
the standara Keyhoard entry currentiv in usee Surjectivelv, 
test subjects on the wnole stated that voice entry was much 
less fatiauing than st ndara xeyhoara entry. The voice rode 
requirec far less ever hand, and heaga maverent te enter 
data. In fact it renuired only that the suoiects tove their 
eyes from the inventory list to the APU and tack. It coula 
be arcued that the novelty of voice entry was resconsinle 
for the test Subjects restonse. while this factor was rot 
tested in tne exneriment;, it 1¢ the autnars oninien that 
novelty was but a minor tactor. Voice entry is a natural 
and comfortable inout tedium to 3 combuter svstem. 

Given the lenath of tha F430 missian and arount cf cata 
which must be input to the svster fer eroacessing it is 
recommended that N4&DC continues its work on crerational 
scenarios for voice data inout far the P-3fl. Voice data 
input could be a significant factor in crea alertnese when 
length of mission is consideres, with tne nensing extended 


mission P-3C uograde, i § role cou'd be consinerapte, 
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SIMULATION FANTETAPIZATION 


Prior to running the experinent vou will ve given tire 
to hecome familiar with the sata entry into tne compter hy 
communicatina data inforwnation usira both voice data entry 
Procedures and Keyboard entry orecedures. The goal of the 
familjarizatior chase is te heccre tamiliar with the types 
of data to be entered aro tke control functions necessary 
for smooth data entry. 


The Summary of Xeyset Syster Commands and the Summary of 
Voice Commands are located at tne end of the Simulation 
ANverview section. Each command will oe utilized in the 
familiarization eoxcersie which follows. 


VOTCE MATA ENTRY FAMTLTAPL7ATION 
1. Put headset m1¢ on. 
2. Tndex displaved 


3. Oysplav Stores Management tableau: use commana "STORES" 
"MANAGFMENT": tne display will then show the first page of 
the Stores Management tableau. 


4, Advance tnrough the 5 panes of the stores management 
tableau usina the command “NFXT PACE", The last line of each 
page says mores. indicatina another paae follows. The 
final page displays -end= in it's lsst line indicating that 
no further pages evist. Use the command "“NFXT PAGE" to 
return you to the first nase of the tableau. 


5. Return to the index tableau by using the command 
"INDEX". The Index may be called uo at any time other than 
when a line is in the process of being modified. 


6. Pysplay Nav Srefliaqht tableau: “ith Index disolayed use 
the command “NAV PREFLIGHT". The display will show the Nav 
Prefliaht tableau. 


7. Data entry?! 
@e Nav Prefliaht displaved 


enter time 
HON #58 BQH HON HOH HOF HENTERY 
line i 220000 
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seed 


line 2 ready 


enter date 

yt ng® wy" it a “wan wae HEN TER 
line ce 49 OT %) 

line 3 ready 


enter latitude 

wan a7" won aft nga wat ".OrTH™ 
line 3 37 24 43% 

line 4 ready 


enter longitude 

wyf non ton “gs age Han bale Ba teF ST? 

line 4 te2 93 24n 

line 5 ready: line & shows “non=modifiable 
line" cue. Go to line 1% to enter mode 1 for 
IFF codes. 


enter mote 1 

a4" "3" Hg WENTER" 
line 13 335 

line 14 reacv 


enter rode ¢ 

"oO" “g* HyN wpe "ENTER" 
line 14 6542 

line 15 reaav 


enter trode 3 
7" go Su “7*" 7" “ENTFR" 
line 15 7777 


line 16 ready: line 16 shows “non-modifiable 
line” cues. Go to line 17 by using either the 
command g 


*LINE17", of “NEXYT LINF® 
line 17 ready 


erter bureau number of a/c and sauadron number 
Hypo omgeA agen fae nye age HyH ge *"ENTER® 

line 17 159704 19 

line 18 ready 


enter call sign 

SMITKE® eMIKE® ay? non age SENTER® 
line 18 i253 

line 19 ready 


enter crew and event number 
"7" *o" eMEKE* mye n4* FMTKE*® i 
line £9 10 114%, also cue “end of page® 
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Call uD tne lune m which errar eccured and re-enter 
correctly. For exarole Mase 2? should have keen 0534 vice 
6542, 

Call up line 14 usina the command "LINE Iu". 
Fnter correctian 

ty" age a aaa nee PRRs 

lire 14 6554 

line 15 readv 


Tf the error is detected orsar to the “enter" command a 


hacksoace function mav tbe ueced by usina the command 
"BACKSPACE". 
Examole: 


Line 15 is opina modified. The desired code is 7777 ana 
your inout is 7707 ana the command "ENTER" has not been 
uttered Use the command "5fCKSPACE" to move hack one space 
per utterance and then irsertinn the correct code 77"7" "7" 
"ENTER". 4Snother methna of correcting the error 1S to use 
the "DELETE LINE" function wrich outs you back to the first 
data entry point of tne line being modified. 


E.amole: 


Line 15 is veing nocified as ahove and the desired code 
is 7777 while your innut was 7767 and the command “ENTER® 
has not been utterea. Jse the command “SELETE LINE™ and you 
will he returned to the first modifiable space in the line. 
Re-enter the correct asta. ; 

b. Pata entry in Stores Yanacement§ tableau: aith Index 
displaved use command “STGRES MANAGEMENT". 


All entries into tke stores inventory are accomplished 
hy two utterances. The first utterance is the sonobouy tyoe 
and it's depth setting? e.a. "41 DEEP". This is a $8841 
lofar bouy usina a deep derth setting. The second uttefance 
is the sonobouv channel sumber and its duration fhow Jong it 
will transmitt before it deactivates): e.g. "25 SHORT". 
This is a channel 23 with a short life setting. This second 


utterance also has an enter function associated with it that. 


will disolay the entry romentarily in the cueing afea and 


then enter it into the inventory while simultaneously 


displaving the next seauential line for modification. 


Observe the format of the tableau sage. The cueing and 


$3 


data entry rea is eat the hottnm of tne pace. The first 
number disriayea fron the left ig the line number of the 
displayed oage. he Second two susbers indicate where the 
bouy 1$ Dhvsically storet an the eircraft 


The segquerce of cata entry is as fol 


Reaav for entry S GH LYK KX KX x 

ENTER oSu4i deer channel 23 short lif* Fy sneanina 
the rommands “41 DFES" #PS LONG" with a short nause 
hetween artries. 


Modifiea line: % G4 Wal P Se aneeee: Gk: Ae 
& Spey = end oy 1S es . mow appears °° the 
cueing area. 


Enter the follewina houys into the svstenr deep 19 
lena, 41 shallow 11 Iona, S3 shallow | longs in locations 
15- 16, and 17 resnecttively. 


CURRECTIONS 


The sare correction orocedures aprly as o#fore. For 
examm}]2: Rouy jiacation tr should be a %3 veeo 15 Iona vice 
53 Shallow 15 Long. Correct this ery calling un line noe 05 
which #8 where couv location 17 is held on this pace. Use 
the command "LINE 4%: line 6 is now sisolayed in the cueing 
area andis reaty tor nogification. Fnter tne correct data 
as betore; "53 MEER" "4S LONG" 


The '‘RACKSPACFE' command may be used here if an error is 
detectea on the first utterance of the line, 1.6. Souy type 
and Deoth. Since tnere are 3 characters in the original 
utterance, "SACKSPACE" would need to pe uttered three times 
to put the cursor in the first modifiable position. The 
correct data covid then ve entered. Fnter the bouys o71 the 
attached pouv status chart to become familiar with the entry 
and correction functions. Another method of correction is 
the commana “DELETE LINE*®. ‘OFLETE LINt* can be used wien 


modifi: ina a line which has not been been entered. As before. 


it will retuen the cursor to the first modifiable character 
of the line beings sadifiedu. ; 


KEYBOARD CATA ENTRY FAMILIARIZATION 
1. Index displaved 


2. Display Stores Managemént tableau: ores Management is 
line 1 of the [ncex. To Gispiay, any wo of any displayed 
page the operator must enter a‘two divit number for that 
line. Precedure: with Index displayed depress "0" "1" 
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"ENTER". Stores Vanagenent is nse asisrlayed on nonitor. 


%. 0 Advance throush tne five sages of Stores VYongagement by 
: using the ‘next mane! key "V" , 


4. Peturn to the Index hy using "TT" "ENTER" (Cterrinates 
Current tableau entry). 


S. Pisplav Yau Preflinht Taktieau: Enter tawo Oiai line 
mumper for ‘iay Prefliaht, 15 "O" "FATER® 


6 Data entry 
Be Nav Prefliohnt 
Fnter timnet keysvt 
Fntered data «ill r 
until "ENTER" is6 de 
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eto neater min en one nenetinnernrenaerpe *° 


ry 

qa rm 

rd 

ov «4 

" 

ba) 

= 
PATRAS SU AM 


on 


enter date 
CONIA, “ENTERS 
Vine 2 99 a1 Ai 
lire 3 readv 


enter Tatitude 
377PK403N “WESTER 
line 3 37 24 G3N 
line 4 ready 


% eater longitude 

. $270324H FFATECR® 
Tine 4 22 93 CuK 
line 5 reaav 


Tine 5 NOR MOUTFIARLF a5 to lire 13 
13 "ENTER® 


enter mode i 

335 "ENTER" - 
line 13 335 

line 14 readv 


enter mode 2 
6542 “ENTER* 
Tine 14 6542 
line 15 ready 
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Hes rm Sh ge eT ee eS a eS eae ee ep NL apn ee Ee «a Spilea gee eae 
eee, a 
soe whales acne} hates =p et 
line 16 rearty 
line 16 son morrfiapdle an ta line 17 
Since 17 je arly one line down nic “ENTER” 
enter bureau stumber of aircraft and squadron numher 
159e@NdGTG FE VIER" 
line 17 189204" 19 
line 18 reary 
enter cali sian 
“123M TENTER" 
line 1R MIet* 
Vine 19 reary 
enter cresn/evert 
1OMIIM “FATES* 
line 19 10 ¥]1% also "END JF PaGE CUE" 
CORPEC TITUS 
Call uo a tine in «which error occured and reenter 
data. 
Fxamolie: “ode 2 sneulg nave heen '6534' vice '6542' 
call um line 14 by hittina 15 "FHTER", 
enter correct dats 
6534 "ERTES*" 
Tine 14 «#534 
line 15 ready 
A hack space function is also available if ar error is 
detectea orior to nitting tne "ENTER" kev suring line 
modification. Each “BACKSPACE" moves the cursor one space 
back as with the “AACKSPACE” cormand in the voice mode. 
Peaceaures "BACKSPACE” to the error: enter correct deta and 
complete the entry for the line then “ENTER* it into the 
Systen. 
b. STGRES MANAGFHENT dara entry 
Fntries into the Stores manacement tableau follows the 
Same rules aS the voice entry with two differences. 1) 
Each character requires & keyset depressions e.d- ge oman 
ps OF #38 MEE MENTER® and 2) Each line must be manually 
entered: by using the enter key vice the automatic entry of 
the voice mode. 
Procedure: 
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A 4 


wy 


need 


TARR buh 


é Display tne TRALY my decressino fen BETTER, visnolay 
Stores Pananeszent bv “enressing vi “EXNTER". Fnter bouys in 


bouy incations startina with location 34 bo to next maa 
hy deoressing TH" TENER RE 


aq, Hit matt FPRTER" AgAIN to je te 


Z fix 5 af Storas 
anaaenrent. ints o14g¢ +tares with Pouy on S4 ara you 
are ready to enter stores. Fnter the fo! houySe 

location bouy 

54 5% S te § 

55 a7 0 PES 

56 d7 P23 5 

St 4) Ro ged 


Correctians are made with the three retnods usea tefore 
mesendina unron when the errar was discovereg: i.e. etther 
after completing an entry or durinao an entry and prior 


entering it into the inventory. 


Correct location SS to read 47 § 20 5 


Froceaure: Jlocatian $5 38 tn line 4 of current oace 
Depress O04 "FRIES" 

line 4 readv 

enter 478295 “FATER® 

Vine 4 47 5 2 & 

Tine 5) ready 


Enter the ouovs on tne attached bouv status chart te 
become familisr eith the entry and correction furctions. 
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1. In general, cdo you lice tne idea of voice data input? 
VERY WHCH NEW AL NOT AT ALL 
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2. Tr general, would vou like tn use voice innut in every 
day tasks vourseif, if +t were anclicahle? 


VERY SUCH MEUTPAL WUT AT ALL 
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3. Po you think that voice innut Fad an advantage over the 
keyset Input for the Stores Mananerent tableau data? If so, 
what was it? 

VERY MUCH NeUTPAaL NOT AT ALL 
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4. Do you think that voice inout hat an advantage over the 
kevset for tne Nav Prefliaht tahleau data? If sor what was 
it? 

VERY MUCH NEUTPAL NOT AT ALL 
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§. Do you think that voice innut bas applications in vour 
military seecialty? if so, what would thev be? 
VERY MUCH NEUTRAL NOT AT ALL 
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